A kinematic analysis of prosodic structure in speech and manual gestures
نویسندگان
چکیده
Two experiments examining the effects of prosodic structure on the kinematic properties of speech and manual gestures are presented. Experiment 1 investigated the effects of prosodic boundaries, stress and their interaction on manual, oral, and intonation gestures (their duration and coordination). Experiment 2 investigated the effects of different types of prominence (deaccented, narrow focus, broad focus, contrastive focus) on oral constriction, intonation and manual gestures (duration and coordination). We recorded speech audio, vocal tract gestures (using electromagnetic articulometry) and manual movements (using motion capture). To the best of our knowledge, this is the first study to examine kinematic properties of body movement and vocal tract gestures concurrently. Preliminary results focus on the effects of prosodic structure on gesture duration and show that 1) manual and oral gestures are longer phrase-initially than phrasemedially and 2) manual and oral gestures lengthen under phrase-level prominence. [Supported by NIH].
منابع مشابه
A Kinematic Study of Prosodic Structure in Articulatory and Manual Gestures: Results from a Novel Method of Data Collection
The primary goal of this work is to examine prosodic structure as expressed concurrently through articulatory and manual gestures. Specifically, we investigated the effects of phrase-level prominence (Experiment 1) and of prosodic boundaries (Experiments 2 and 3) on the kinematic properties of oral constriction and manual gestures. The hypothesis guiding this work is that prosodic structure wil...
متن کاملThe Prosody of Discourse Structure and Content in the Production of Persian EFL Learners
The present research addressed the prosodic realization of global and local text structure and content in the spoken discourse data produced by Persian EFL learners. Two newspaper articles were analyzed using Rhetorical Structure Theory. Based on these analyses, the global structure in terms of hierarchical level, the local structure in terms of the relative importance of text segments and the ...
متن کاملCo-Production of Contrastive Prosodic Focus and Manual Gestures: Temporal Coordination and Effects on the Acoustic and Articulatory Correlates of Focus
Speech, and prosody in particular, is tightly linked to manual gestures. This study investigates the coordination of prosodic contrastive focus and different manual gestures (pointing, beat and control gestures). We used motion capture on ten speakers to explore this issue. The results show that prosodic focus "attracts" the manual gesture whichever its type, the temporal alignment being strict...
متن کاملGesture and speech coordination: the influence of the relationship between manual gesture and speech
Communication is multimodal. In particular, speech is often accompanied by manual gestures. Moreover, their coordination has often been related to prosody. The aim of this study was to further explore the coordination between prosodic focus and different manual gestures (pointing, beat and control gestures) on ten speakers using motion capture. As compared to previous studies, results show that...
متن کاملMental Timeline in Persian Speakers’ Co-speech Gestures based on Lakoff and Johnson’s Conceptual Metaphor Theory
One of the introduced conceptual metaphors is the metaphor of "time as space". Time as an abstract concept is conceptualized by a concrete concept like space. This conceptualization of time is also reflected in co-speech gestures. In this research, we try to find out what dimension and direction the mental timeline has in co-speech gestures and under the influence of which one of the metaphoric...
متن کامل